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Consequently,  the  criteria,  such  as  the  interval  between  the  classes  ot 
images  and  metric  parameters  of  classes  in  N-dimensional  index  spaces 
within  which  one  can  realize  (as  points)  arbitrary  classes,  are 
investigated  mathematically.  Technical  limitations  are  compared  with 
the  results  of  mathematical  simplifications  of  the  exact  theory. 
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THE  CONNECTION  OF  METRICS  OF  VISUAL  AND  AUDIO  SPACES 
FOR  A METHOD  OF  TRANSFORMING  AN  IMAGE 

INTO  SOUND 

V.  G.  Grishin 

Previously  [1,  2]  was  proposed  and  experimentally  investigated 
a method  of  transforming  an  image  into  sound  for  the  purpose  of 
relieving  the  operator’s  vision  and  expanding  its  possibilities.  All 
our  reports  devoted  to  this  transformation  method,  were  based  on 
a certain  model  of  aural  perception. 

It  is  interesting,  evidently,  to  investigate  the  given 
transformation  algorithm  also  from  the  viewpoint  of  general  criteria 
of  the  theory  of  recognizing  pictures,  having  no  direct  connection 
with  the  psychophysiology  of  the  operator. 

Such  criteria  appear  to  be  distinction  between  classes  of 
pictures  and  metric  parameters  of  classes  in  N-dimensional  space 
of  signs,  in  which  any  possible  realization  of  any  given  class  is 
represented  by  a point.  If  in  role  of  signs  of  our  initial  visual 
pictures  are  selected  brightnesses  of  their  individual  points, 
then  to  each  image  will  correspond  a point  (vector)  in  N-dimensional 
space,  where  N — is  determined  by  the  required  according  to  problem 
conditions  discrimination  of  picture  details  — resolving  power. 
Considering  the  N-dimensional  space  of  signs  euclidean,  we  will 
obtain  the  following  expression  for  the  distance  between  points  a 
and  v : 
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(1) 


In  our  case,  when  the  initial  depictions  F(x,  y)  are  spread 
by  y on  n-equal  bands,  and  by  x they  are  considered  continuous  and 
in  general  case  with  infinite  resolving  power,  expression  (1)  is 
transformed  into  form 


h — width  of  band  y^  (line),  equalling  Jl^/n,  a,  and  — area 
boundaries  of  designating  F(x,  y). 

The  investigated  transformation  of  each  input  picture  places 
a conformal  time  function  f(t)  on  the  designation  interval  [0,  T] 
by  the  law 


where  $^(x)  and  are  determined  above,  — initial  phase  of  the 


Introducing  a euclidean  metrics  into  the  space  of  signs  of 
synthesized  functions  f(t),  we  will  obtain  for  function  f(t)  and 


(2) 


where 


(3) 


n 


(4) 


carrier,  and  x with  t are  bound  by  ratio  x = £^/T. 


(5) 


f^(t)  corresponding  to  functions  F(x,  y)  and  F^(x,  y)  a distance 


• 1 


T 


(6) 


o 


Substituting  in  this  expression  (4),  we  will  obtain 


’ r2(f,  /»)>  W{c*)' 


• sin(u>k£-j- dt.  . 


(7) 
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Having  grouped  the  subintegral  expression  by  identical  indices;, 
we  will  come  to  an  expression: 

T 


* n 

r2(J>  /')=  (j  £ [<Pk(o*)— «Pk,(^)]sin(o)k/f  4-  ^k)2 
J k=i  • „ . * 


at. 


The  change  in  form 


gives 


■ r‘(f,  />)=  f 


o 


n 

sin  (ukif 

k—  1 


dt 


which  after  squaring  leads  to  an  expression: 


(8) 


(9) 


(10) 


T 


2(/»  P) — ( ^^k2(Q  Sin2(u)k^-j~t};k)^~f~ 


k=  1 


T 


+ 


I sin  sin 
J k.  1 


(ID 


where  l — independent  from  k index,  acquiring  the  very  same  values, 
as  k,  whereby  i ? k. 


The  first  integral  (11)  can  be  written  so: 


T n T.n  . 

^ = -f  \ S V(0<«  - “f  Z W)cos2K 

0 *Jk=l  . 

o K — 1 n 


(12) 


O 4 o 

But  the  first  member  of  this  expression  is  nothing  else  than 

(2)  after  substituting  here  (5),  i.e.,  (12)  can  be  recorded 

1 t n 

rhf,  n 


A = 


2 a 


X V(Ocos2(<ok*+«J>k)rf/ 


(13) 


k=  1 


o 


Assuming  that  6^  (t)  is  a slowly  changing  function  as  compared 
with  cos  2m^t  and  adopting  known  trigonometric  transformations,  we 
will  obtain  from  (13)  the  following  expression: 


R2  _ sin2o)k7’  . 

-4-  = — — Y cos20k — r — — VW— 


n 

Y sin2 
ac  = 1 


A 


k=  1 

V(79 

2u)i- 


2u)l 


cos2u>kr— ik— 

2<,k  J J 


(14) 
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At  this  assumption  we  transform  the  second  integral  of  equation 
(12),  as  result  of  which  we  will  obtain: 


r\f,  /')= 


R‘ 


n 


2 a 


— V sin  2^k 
k*l  - 


f-  V cos2;k 

Jtrru 

k-1 

vm 


sin  2u \T 

2u>k 

&k2(o) 


V(T')- 


cos2u)kr 

2u)k  2u)k  _ 


n 

- V 

k-1 


cok-h<^j  2 . ..  2 

2Sk(o)c  (o) 


u)k  + 


lii£l  sin-ii^iL  1 + . 

u>,  . • 2 - J . *.  •. 


+ > 


k.  J 


\2\(T)lx(T)l  mk_ 


U)i 


sin 


I0k UJj 


^k— Vi' 

. '2 


2ok(o)c1(o)  $ln 

U)k U).  - . 2 


]•:  ■ 


(15) 


We  will  analyze  the  obtained  expression. 


1.  Having  fixed  for  given  visual  pictures  boundary  conditions 
of  form 

sp^p^Vk^o)  and  ok(l)=$k'(l),  (16) 

we  will  obtain  from  (15) 


a/,  & ,,  R{F,  Fl) 

r2(f>  /•)=  — — or  r(f,  f')  = — v ’ — L, 


2 a • 


2a 


(17) 


i.e.,  at  these  limitations,  applied  on  functions  F(x,  y),  the 
distances  between  the  formed  accoustic  pictures  in  space  of  their 
signs  differ  from  corresponding  distances  between  the  initial  signs 
only  at  a constant  multiple. 


It  Is  evident,  that  requirement  (16)  can  be  easily  realized 
practically  in  form  of  a mask  at  recoder  Input  with  transparency 
in  change  along  axis  x by  any  of  the  rules  shown  in  Fig.  1 or 
having  organized  a change  in  sensitivity  of  the  photo  field  along 
axis  X by  any  one  of  these  dependences.  Whereby  the  rate  of 
increasing  the  sensitivity  or  transparency  with  the  removal  from 
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X = 0 and  X = is  bound  with  the  above  posted  requirement  of 
slowness  in  change  i|^(X)  after  comparing  with  the  carrier  oscillations 

It  can  easily  be  seen,  that  the  proposed  technical  realizations 
are  equivalent  to  much  more  stronger,  than  (16)  limitations,  which 
can  be  written  so: 

¥k(°)=¥k1(o)~?k(O=¥k1(0=0.  (18) 


This  equality  should  be  understood,  apparently,  not  as  a 
requirement  to  initial  visual  pictures,  but  as  result  of  above 
described  processing  of  same  at  the  input  of  the  installation. 
Naturally,  that  in  this  case  is  lost  the  entire  information  about 
boundary  areas  with  X = 0 and  X = & . 


2.  Possible  are  also  other  simplifications  of  formula  (15). 
Actually,  placing  ^ = c °°H  an<^  = b j where  b and  c are  any 

integral  positive  numbers,  i.e.,  placing  all  carrier  frequencies 
of  the  recoder  as  integral  multiples  of  the  sounding  period  of  the 
entire  picture  (period  of  reading  the  visual  picture)  T,  we  will 
obtain 


rHf,  Z1)^ 


R 2 


2 a 


■ V sin2bk 
k — 1 


hxn-h2(o) 

2o>k 


sin 


Yk  Tl 


sin  ] 


k.  1 


2 


0)k— 


COk-bu>| 


■J 


(19) 


At  ^ = 0,  i.e.,  at  zero  initial  phases  of  all  carriers 

for  any  k and  £ (19)  is  reduced  tq  (17).  An  analogous  situation 
originates  also  during  equality  6^(T)  = 6^,  equivalent  to  a much 
weaker,  than  (16)  requirement: 

?k(o)-9k,0 =?k(/)-?k,(0  (20) 

Above  we  imposed  on  6 (t)  a slowness  of  change  requirement  in 

comparison  with  sin  2m^.t,  which  is  practically  equivalent  to  the 
requirement  of  change  slowness  4>^.(t)  in  comparison  with  sin 
necessary  for  picture  coincidence  of  instant  spectrum  of  signal 
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f(t)  formed  by  transformation  wi;h  initial  picture  F(x,  y)  [2], 

This  fact  confirms  the  internal  bond  of  the  approach  to  transformation, 
emanating  from  the  adopted  by  us  model  of  aural  perception,  and 
the  pure  mathematical  approach  to  this  problem. 


The  very  requirement  of  change  slowness  4>^.(t)  in  comparison 
with  sin  co^t  is  equivalent  to  the  smallness  requirement  of  Fourier 
series  coefficients,  in  which  $^(t)  is  decomposed  at  members  with 
frequencies,  comparable  and  greater  than  This  condition  can 

also  be  expressed  in  another  way: 


2* 

“>k 


dok(t) 

dt 


(21) 


for  any  given  t and  k,  which  can  be  determined  as  a smallness  in 
absolute  increment  of  function  <j>^(t)  by  an  interval  equal  to  the 
period  of  frequency  in  comparison  with  the  value  of  the  very 
function  in  this  interval.  Since  the  rate  of  change  <$>,  (t)  depends 
upon  the  time  of  reading  the  lmag3  T(X  = £,^/T*t),  then  the  above 
described  requirement  is  practically  reduced  to  a requirement  of 
increasing  T,  leading  to  a reduction  in  rate  of  change  of  X in 
dependence  upon  t,  and  consequently,  also  to  a reduction  in  rate 
of  change  cj>^(x)  = ^(Jl^/T't)  in  comparison  with  sin  w^t. 
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